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Abstract 

In this note we analyse various stability properties of the max-min 
fair Rate Control Protocol (RCP) operating with small buffers. We first 
tackle the issue of stability for networks with arbitrary topologies. We 
prove that the max-min fair RCP fluid model is globally stable in the 
absence of propagation delays, and also derive a set of conditions for local 
stability when arbitrary heterogeneous propagation delays are present. 
The network delay stability result assumes that, at equilibrium, there is 
only one bottleneck link along each route. Lastly, in the simpler setting 
of a single link, single delay model, we investigate the impact of the loss 
of local stability via a Hopf bifurcation. 

keywords rep, max-min fairness, small buffers, stability, bifurcation. 

1 Introduction 

The Rate Control Protocol (RCP) [HIS] takes a radically different approach to- 
wards managing flow and congestion control as compared to the existing Trans- 
mission Control Protocol (TCP) congestion avoidance framework. The TCP 
framework has, imbedded in it, an implicit mechanism for detecting conges- 
tion within the network. Loss of a packet, caused by the overflow of a buffer, 
is intended to provide the necessary feedback information. In sharp contrast, 
RCP aims to achieve fast flow completion times by communicating explicit rate 
feedback between routers and end-stations dj. RCP is closely related to the 
eXplicit Control Protocol, XCP [TT; another algorithm which proposes the use 
of explicit rate feedback. Both the RCP and XCP algorithms intend to converge 
to a max-min fair resource allocation [2l[5l|TT]; see [HI [T71 [181 [22] and references 
therein for a sample of the literature exploring various issues related to different 
notions of fairness in a networking context. 

The performance of congestion control algorithms is often coupled with the 
choice of certain parameters in routers in the network. For example, such param- 
eters may correspond to different choices of Active Queue Management (AQM) 
schemes [3l [TOl [141 [H], or the size of buffers in routers [H [20]. Researchers 
have begun questioning the design rules for sizing buffers in core routers in the 
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Internet [T] and some recent literature [71 [501 [21] suggests that buffers should 
indeed be much smaller as compared to the current design principles. In light of 
the separate developments made towards the understanding of RCP [H HUHl IS] 
and buffer sizing [T] [T] HOI [IS] it is natural to investigate the two, i.e., RCP 
and small buffers, together. Such an investigation is also motivated by the 
observation that previous buffer sizing studies have focussed primarily on the 
impact of smaller buffers with TCP. In this paper, the focus of our analysis will 
be on the limiting regime of a max-min fair RCP fluid model operating over a 
communication network with small buffers. 

Previous control theoretic analysis of RCP has focussed on a single bottle- 
neck, where the queue is modelled as a saturated integrator [5]. In our work, 
we assume that the size of the buffers is small enough so that it is no longer 
possible to exphcitly model the queue. Rather, with such small buffers, at the 
time scale of operation of the congestion controllers, it is the distribution of 
queue size that plays the important role [25]. It is worth stating that we do not, 
in any way, contribute to the question of exactly how small the size of buffers 
ought to be. The model we analyse is simpler than the one analysed by [1] in 
that we do not explicitly model the queue, but more involved in the sense that 
our framework represents a heterogeneous network of arbitrary topology. In our 
fluid model for RCP, apart from the model for the queue, all other parameters 
are exactly the same as specified in the original RCP algorithm [S]. 

The styles of analysis we employ have all been popular in the study of conges- 
tion control: for example, global stability without propagation delays [2T1 [24] . 
local stability with delays [U [TOl [IS [HI [151 EH [23] , and also an analysis of the 
dynamic system when stability may not be guaranteed [9] [13l [19] . 

We now outline the essence of our contribution. First, we prove that the fluid 
model of RCP is globally stable in the absence of propagation delays. Then, 
we derive a set of conditions for local stability when arbitrary heterogeneous 
propagation delays are present. The network delay stability result relies upon 
the assumption that, at equilibrium, there is only one bottleneck link along each 
route. Furthermore, in the simpler setting of a single link, single delay, model 
we are able to provide a more in depth study of the RCP algorithm. Using 
bifurcation analysis, we investigate the impact of the loss of local stability in a 
special case where we show that the RCP algorithm would always give rise to a 
super-critical Hopf bifurcation. 

An overview of this paper follows. In Section 2, we analyse the stability 
properties of RCP over networks of arbitrary topology. In Section 3, we inves- 
tigate local instability of RCP in a single link, single delay, model via a Hopf 
bifurcation analysis. Finally, in Section 4 we summarise our contribution, and 
discuss some avenues for further research. 

2 RCP over arbitrary topology networks 

In this section, our objective is to analyse the stability of RCP in a small buffer 
regime, over networks with an arbitrary topology. We first show global stability 
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for the RCP fluid model in the absence of propagation delays and then derive 
a set of conditions for local stability when arbitrary heterogeneous propagation 
delays are present. The network delay stability result relies upon the assumption 
that, at equilibrium, there is only one bottleneck link along each route. That 
is, at equilibrium, for each route there is a unique link with minimal per-flow 
bandwidth available. We begin with the model description. 

2.1 Model description 

At the level of theoretical abstraction, our set up for an Internet like communi- 
cation network follows the commonly adopted framework ^21j . 

We suppose that the communication network comprises of an interconnection 
of a set of routes^ 5, with a set of links, J. Each route r £ S represents a user 
of the network. Associated with each route is a set of links which represents 
the path along which that user transmits information through the network. 
Further, a route r has associated with it a flow rate Xr{t) > 0, which represents 
a dynamic fluid approximation to the rate at which the user is sending packets 
along route r, at time t. 

The flow rate, for each r £ S is determined by the links I S r, via the use 
of explicit rate feedback. Each link I € J has associated with it a flow rate 
Ri{t), which represents the maximum flow rate allowed for routes which pass 
through I. Each packet which is sent through the network carries, in its header, 
an explicit rate feedback variable. This variable is initially set to the maximum 
desired flow rate for r. As the packet passes through each / e r, if the feedback 
variable is greater than Ri (t) , then link I sets it equal to Ri (t) . When the packet 
reaches its destination, an acknowledgement packet (ack), containing the flnal 
value of the explicit rate feedback variable, is returned to the origin of r, and 
the flow rate Xr{t) is updated accordingly. 

For each route r and link Z G r, we let Tri denote the propagation delay from 
the origin of r to /, i.e. the length of time it takes for a packet to travel from 
the origin to link / along route r. Let Tir denote the propagation delay from I 
to the origin of r, i.e. the length of time it takes for the explicit rate feedback 
information from link I to reach the user who is transmitting along route r. In 
RCP, a packet must reach its destination before an acknowledgement packet 
(ack) is returned to its source. Furthermore, as we are interested in a network 
with small buffers, we may safely assume that queuing delays are a negligible 
component of the end to end delay. Thus for all / e r, t^; + t;,. = t^, the round 
trip time for route r. 

We now have the following model for the end-system behaviour of RCP. For 
each route r £ S, 

Xr{t) = laini^rRlit - Tir). (1) 

Now, for each link I G J, Ri{t) is updated depending upon the total aggregate 
flow through link I at time t. Although the update rule is discrete, we can model 
it via a fluid approximation with the following differential equation . For each 



3 



link / e J, 

where ai,(3i are positive constants, C'l is the capacity at hnk I, di is the average 
round trip time of the flows passing through hnk I, 

and (7;(i) is the queue size at time t. Here we use the notation a ~ (6)+ to mean 
that a = if 6 < and c < 0, otherwise a = b. In the original RCP model [5], 
ai = a and Pi — (3 for each / G J for some a and (3. We have allowed these 
constants to vary between links in order to study their effect on stability. 

Model for the queue. The basis of our investigation is to study a regime 
where the buffers are so small that it is no longer possible to explicitly model 
the queue as a saturated integrator. This assumption simply expresses the idea 
that with small enough buffers, we may use the approximation 

qi{t)^pi{yi{t)), (4) 

where is a continuously differentiable function representing the mean queue 
length of link I. This is consistent with the observation in [5S] that in a small 
buffer regime, it is the distribution of the queue size that plays the prominent 
role in the dynamics of the congestion control framework. At the level of interest 
in this paper, we do not motivate any explicit functional form for the mean queue 
length. Different functional forms may be suitable candidates, but our primary 
focus is to investigate some stability properties of the dynamical system defined 
by (HEl). 



2.2 Global stability without propagation delays 

In this subsection, we seek to investigate the stability properties of RCP without 
taking into account the effects of propagation delays. This gives us some insight 
into the stability of the algorithm in general, and is also a plausible model for 
the special case when propagation delays are small in comparison to the update 
step size of the algorithm. In terms of the fluid model, this would mean 

, !3iqi{t) . 1 
^ mm ■ 



iGJ diCl dfCl res Tr ' 

To model RCP without the effects of delays, we use (HM]), setting = for all 
r £ S, but leaving all other parameters fixed. 

Ideally we would like to show that our delay-free model of RCP, at equilib- 
rium, is globally stable. Unfortunately, as the following example demonstrates, 
we cannot expect the equilibrium points of ([TJl]) to be unique, or even isolated. 
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Consider a network consisting of two identical links, /, j and one route r = {/, j}. 
Then, since pi{-) is strictly increasing, there exists a unique y such that 

ai ,^ ^ Pwijy) ^ 



By inspection, there are equilibrium points at i? = (y, y') and R = (j/', y) for all 

y' > y- 

Alternatively, consider the situation where I and j are not completely iden- 
tical, and Cj > C'l. Then, there exists a unique y' such that 

ic,-y')-^-^-o. 



djCj d'jCj 

Now, y' > y, so, if < y then Rj will be strictly positive. However, if Xr > y 
then Ri will be strictly negative. Thus, for this example, no equilibrium point 
exists. 

So, there may be an entire manifold of equilibrium vectors for R, or there 
may be no equilibrium point at all. However, the same is not true for the 
equilibrium vector of flow rates x. 



Theorem 2.1. Suppose that x(t) evolves according to fllj^P; with = for all 
r Cz S . Then, there exists a unique vector x such that x{t) x as t ^ oo. 

Proof. We prove this result recursively for the more general system where, for 
all I G J, we replace ([2]) with 



Mt) - Mt) ( nit) + ^(C, - ym - ^^^If^ ) , (5) 



RiW 



where ui(t) as t — > oo. 

Let TV; be the number of r G S' such that I G r. We set Iji equal to the unique 
value such that Ri{t) = when yi{t) — IJi, and set R = mini^jyi/Ni. We shall 
show that, for all r G 5* with R = yjNi for some / e r, a;^ ^ i? as f ^ oo. This 
allows us to remove such an Xr{t) from the system, by replacing it with R plus 
a vanishing term which we incorporate into the ui(t), for each I G r. Since this 
will always remove at least one r from S, this is sufficient to prove our result. 

It remains to show that Xr ^ R for r G S with R = Iji/Ni, for some I G r. 
Now, for any e > there exists a T such that 

\ui{t)\ < e 



diCi' 



for all Z G J, t > T. From (O we see that, if, for t > T, for any I G J, 
Ri{t) < {yjNi) - 2e, then Ri{t) > 5 for some 6 > 0. Thus, for some T', for aU 
t>T',lGJ,Ri{t)>{yi/Ni)-2e. 

Let us assume that e is small enough that, for any j G J with (ijj/Nj) > R, 

^ -R> ( 2 + 2max7V; 
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Now, let r € S be such that R = Ui/Ni for some I G r. Let r' be the set of 
I G r with R — Vi/Ni. Suppose that, for some t > T', 



min Ri {t) > R + 2e max Nj . 




If Xr{t) = Rj{t) and j E r' then ^^(t) > R + 2emaxj^j Nj. Otherwise Xr{t) = 
Rj{t) with j ^ r' , but since t > T', Xr > R + 2emaxjgj Nj still holds. For any 
I € r' , Xr{t) is sufficiently high that yi{t) must be greater than NiR + 2e. Thus, 
Ri{t) < -d for some i5 > 0. Therefore, for some T", for aU t > T", 



Note, the vector x will be close to that of the max-min fair allocation of flow 
rates, because of its construction. However, the presence of the function pi{-) 
in (12) means that link capacity will not be fully utilised at equilibrium. 

2.3 Local stability with propagation delays 

In this subsection, we derive conditions for the local stability of ([TJU]) when 
propagation delays are present. Our result relies upon the assumption that 
there is only one bottleneck link along each route, that is for each r E S there 
is only one I G r such that Xrit) — Ri{t) at equilibrium. 

For each r € S, I € J, we let Xr be the equilibrium value of Xr(t) and Ri 
be the maximum of Xg for all s £ S" such that I € s. For each I € J, we let yi 
be the unique value such that Ri(t) = whenever yi{t) ~ yj. We can assume, 
without loss of generality, that for all I G J, 



Otherwise, assuming the system is always local to equilibrium, Ri(t) will simply 
continually increase. If Ri(t) is initially large enough then max^gs < Riify 
for all time and thus, Ri(t) has no effect on the rest of the system, and can be 
ignored. 

Now, we have assumed that, for all r G 5, / G r, if af^ = i?/, then Rj > Ri for 
all j E r, j =/= I. Furthermore, by definition, if Xr =/= Ri, we must have Xr < Ri- 
Thus, for all r E S, I E r, whenever the system is close to equilibrium, either 
Xr{t) = Ri(t — Tir), or else Xr < Ri and Ri{t — Tir) has no effect on Xr(t). So, 
we can isolate each I E J and model the effect of the rest of the system on Ri (t) 
as a vanishing perturbation. This allows us to find conditions for stability for 
the overall system using a recursive argument. 



min Riit) <R + 2e max iV,- . 
ler' jej 




□ 




r:l^r 
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Accordingly, we initially restrict our attention to the single link case, J = {/}, 
and we consider the following generalisation of ([2]), 

Ri{t) - -Ri{t)(fi(yi{t) - NiRi) +ui{t)\ , (6) 
V ^ ^ /i?i(t) 

where yi{t) is defined as in ([3]), /;(•) is an increasing difl^erentiablc function with 
/z(0) = and ui{t) — > as i ^ cx). When the recursive argument is complete, 
the vector u{t) represents the behaviour of Rj{t) for j ^ J such that Rj < Ri. 

Theorem 2.2. Consider the case where the network consists of only a single 
link, J = I, with flow rates following // 

fi{Q)RiJ2rr < 1, 

res 

then for all e, there exists a and u such that, if \Ri{t) ~ Ri\ < a for all t < 
and \ui{t)\ < u for all t, then — < e for all t, and Ri{t) — > Ri as 

t oo. 

Proof. Let t; be maxrgs''r, the maximum round trip time. 

Suppose for some i, 7 < 1, a' and u'; \Ri{t) — Ri\ = 7a', \Ri{t') — Ri\ < a' 
and \ui{t')\ < u'a' for all t' e [t ~ 2r;, t]. Then, for all t' e [t - Ti,t], 

Ri{t')\ < (Ri+a') (u'a' + fimS\a' + oia')y 
Thus, for aU r eS, 

\Riit - Tr) - Riit)\ < rrRif'i{0)\S\a' + (Ri + a') a'u' + o(a'). (7) 

So, 



Ri{t) 
Ri{t) 



f'M{\S\Ri~Vi{t))~ui{t)+o{a') 

//(0)|5| [Ri - Ri{t)) - ui{t) + //(O) {Mt) -Ri{t- Tr)) + o(a') 



res 

fimS\ja' + S, 



where 



\S\ < fliO)Ri rrflmSla' + \S\ti {Ri + a') a'u' + o(a') 



res 

= f'i{Of\S?Ridia' + \S\ti {Ri + a') a'u' + o{a'). 

Since f'i{0)\S\Ridi < 1, there exists a value of a < e, u' and 7 < 1 such that, if 
a' < a, then \6\ is guaranteed to be less than 7//(0)|S'|a'. In which case, Ri{t) 
must have the same sign as Ri — Ri (t) . 
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with a as given above, and if — < a for 

alH < and \ui{t)\ < u for all t, then \Ri{t) < e for all t. 

Furthermore, for all a' < a, there exists a time T such that, for all t > T, 
\ui{t)\ < u'a' . From the above analysis, we know that after T, if Ri{t) is beyond 
a' of i?/, then it will converge to Ri at a rate of 7. Thus, there is some T' > T 
such that, \Ri{t) — Ri\ < a' for all t > T'. Since a' was arbitrary, — > i?; 
as required. □ 

We now consider the general network case. 

Theorem 2.3. Under (Tj^, the equilibrium point R is locally asymptotically 
stable provided that, for each I G J , 

r:l£r,Ri—Xj. 



Proof. Let S be the minimum of — i?j | /2 for I j E J. Now, if, for all t, 
all I E J, \Ri{t) — Ri\ < S, then each I G J will evolve according to 

Mt) - -i?^w(/KyrW -r) (9) 

where ui{t) represents the effect of Rj{t) for all Rj < Ri, and 

= ^Xr{t~Trl), 
r:lGr,Xj. — Ri 

with equal to the equilibrium value of y'^^{t). For each / G J, we have 

fii^) ^ —iw + yi-Ci) + — '4^. — - 



did' ■ dfCi 

By definition, ([9]) is an example of ([6]), for the reduced network formed by I 
and all routes r E S with / G r and Xr = Ri. Furthermore, ([8]) is precisely the 
condition of Theorem 12.21 for this reduced system. 

Suppose \Ri{t) — Ri\ < (5 for all I G J, for all t. By differentiability of 
for any u, we can find e such that if \Rj{t) — Rj\ < e for all t, for all j such 
that i?j < Ri, then < u for all t. This allows us to prove local stability 

recursively. 

We begin with the I E J such that Ri is maximal. We apply Theorem 12.21 
to find conditions under which Ri (t) converges to Ri and \Ri{t) ~ Ri\ < S for 
all t. This gives us a and u, where the initial conditions of Ri(t) should be 
within a of Ri, and ui{t) should tend to zero and always be bounded by u. We 
can find an e < (5 so that if | Rj {t) — Rj\ < e for all t and Rj (t) converges to 
Rj for all j ^ I, then \ui{t)\ < u for all t and ui{t) converges to 0. So, we set 
Ri{t) G [Ri-a,Ri + a] for t < as our initial condition for I , remove I from the 
network and repeat this process for 6' = e. Since we remove one link each time, 
eventually we will find suitable initial conditions for the entire network. □ 
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Note, each link does not necessarily need to keep track of which flows are 
under its control in order to meet ([8]). The condition holds if, for all I £ J, 

where is the average per packet round trip time, 

dj — Xfi'f • 

This suggests that it should be c?f not di that appears in the RCP controller ^ . 
If, for each I € J we let 7; be such that p'liyi) ~ IWi^Vi) Ivi then, 

, aidi Ci - Vi ^laidi 

PAVi) = 11— i = < —5—' 

Pi Vi Pi 

thus, ([5]) is ensured if, for all I G J, 

ai = -TT-^ r- (10) 

This parameter choice scheme is attractive, because it is fairly decentralised 
and only requires local information. Each link needs only to measure, estimate 
or be informed of the round trip times for packets passing through that link. 
However, these results rely on the weak assumption that each route has only 
one bottleneck link. However, any network with multiple bottleneck routes 
can easily be transformed into one without, for example, by making a small 
change in the parameters /3/, Z e J. Preliminary numerical results suggest that 
Theorem l2.3l mav hold in general; but finding an analytic result to confirm this, 
or a counter-example to disprove it, remains an open problem. 

In the next section we investigate the impact of loss of local stability in RCP. 



3 Local bifurcation analysis 

A key focus in the choice of parameters for any congestion control proposal is 
to ensure that they lead to a stable equilibrium. Most proposals for congestion 
control, for example see [5Tj, lead to the analysis of non- linear time delayed 
dynamical systems. For such non-linear systems, typically sufficient conditions 
for local stability guide parameter choices. Following local stability, a local 
bifurcation theoretic analysis can make us comfortable in running the system 
close to the edge of stability. 

We first recapitulate a result about the loss of local stability in a non-linear 
retarded functional differential equation and then use it to analyse the RCP 
fluid model. Following the analysis in [19j we outline a local Hopf bifurcation 
result for the following non-linear delay equation 

u{t) = v{ - ixu{t -t)± ^^yu{t)u{t - r)) , (11) 
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where rj^T^S^x,^xy > 0. The parameter rj has been intentionally introduced to 
just tip the above equation over the edge of (local) stability. This exogenous, 
non-dimensional, parameter will act as our bifurcation parameter. 
We may state the following about equation ([TT|) . 

Theorem 3.1. A necessary and sufficient condition for local stability is 

7]C^T < 7r/2, 

and treating rj as the bifurcation parameter, the first local Hopf bifurcation occurs 
with period 4r at rj = rjc, where r]c£,xT = 7r/2. Further, as the Hopf condition is 
just violated, the equation will always undergo a super- critical Hopf bifurcation 
where the amplitude of the stable bifurcating solutions will be proportional to 

/ 207r(?7-77c) 



3.1 RCP: single link, single delay model 

In our bifurcation analysis, for the sake of simplicity, we shall leave the queuing 
term out of the model by taking (3 — 0. Consider the following single link, single 
delay, RCP fluid model 

m-vRit)[-^{C-yit))), (12) 

where y{t) = J^s ~ ''') aggregate load at the link and rj is the non- 

dimensional bifurcation parameter. Define u{t) = R(t) — R, and take a Taylor 
expansion of (fT2|) to obtain 

u{t) — — r]—u{t — r) — i]^=u{t)u[t — t). 
T tR 

Now using Theorem 13. li we may state the following about equation (fT2|) . A 
necessary and sufficient condition for local stability is 

rja < 7r/2, 

and treating rj as the bifurcation parameter, the first local Hopf bifurcation 
occurs with period At at rj — rjc, where rjcCn = 7r/2. If the Hopf condition is 
just violated, the equation will always undergo a super-critical Hopf bifurcation 
where the amplitude of the stable bifurcating solutions will be proportional to 



/207r(7;-r;,) 



37r-2 

We highlight that equation (|12p cannot produce a sub-critical Hopf bifurcation. 
However, in the bifurcation analysis we have omitted any additional non-linear 
effects that would arise if /? > in the RCP model. 

We now summarise our contribution in this paper, and outline some avenues 
for further research. 
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4 Conclusion 



It is noteworthy to observe that the smaU buffer regime has aUowed us to tackle 
the question of stabihty for a large network with an arbitrary topology. First, we 
proved that the RCP fluid model is globally stable in the absence of propagation 
delays. Then, we derive a set of conditions for local stability when arbitrary 
heterogeneous propagation delays are present. The network delay stability re- 
sult relies upon the weak assumption that, at equilibrium, there is only one 
bottleneck link along each route. An interesting avenue for research would be 
to show that either this result may hold in general, or provide a counter-example 
to disprove it. Finally in a single link, single delay, model we investigate the 
impact of the loss of local stability in a special case (setting /3 = 0) where we 
show that the RCP algorithm would always give rise to an innocuous looking 
super-critical Hopf bifurcation. 

As RCP aims for max-min fairness it is appropriate to first consider a model 
that embodies the original formulation, as we did in this paper. We now outline 
some natural avenues for further research. 

Fairness and Stability. A conveniently parameterized family of a-fair rate 
allocations was introduced in [17] . The parameter a lies in the range (0,oo), 
and the cases a — > 0, a = 1 and a —^ oo correspond respectively to an alloca- 
tion which achieves maximum throughput, is proportionally fair or is max-min 
fair [17j . In this paper we have only considered a max-min fair allocation mech- 
anism, as has been originally specified [5j. An immediate direction of further 
research would be to incorporate different notions of fairness into the RCP 
framework, and analyse the stability of such networks. 

Impact of the RCP parameters: ai and [3i. We have only considered the 
limiting case of very small buffers. The choice of /? impacts the rate at which 
the queue is drained. Small values of (3 drain the queue slowly; so with small /3 
and for large enough buffers it is appropriate to model the queue as a saturated 
integrator. However, for large values of /3, the queue may drain fast enough 
so that at the timescale of operation of the congestion control protocols, finer 
queueing theoretic models may have to be developed. Such queuing models 
would certainly contribute to the non-linearity in the RCP dynamical system, 
and hence impact the stability of the time delayed network. Further, the results 
from local bifurcation theory could also be subtle. In our bifurcation theoretic 
analysis we set /3 = 0, thus removing any non-linearity that may arise from the 
queue. 
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